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Abstract. Let H = (hij) and G = (gij) be two m X n, m < n, random matrices, each with 
i.i.d complex zero-mean unit-variance Gaussian entries, with correlation between any two elements 
given by ¥,[hijg*^] = pSipSjq such that \p\ < 1, where * denotes the complex conjugate and Sij 
is the Kronecker delta. Assume and {ri}y}_-^ are unordered singular values of H and G, 

respectively, and s and r are randomly selected from {sk}^_-^ and {rjjj^j^, respectively. In this 
paper, exact analytical closed-form expressions are derived for the joint probability distribution 
function (PDF) of and {ri}^-^ using an Itzykson-Zuber-type integral, as well as the joint 

marginal PDF of s and r, by a bi-orthogonal polynomial technique. These PDFs are of interest in 
multiple-input multiple-output (MIMO) wireless communication channels and systems. 

Key words, correlated complex random matrices, joint singular value distribution, bi-orthogonal 
polynomials 
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1. Introduction. Random singular values have found numerous applications 
such as hypothesis testing and principal component analysis in statistics [13], nuclear 
energy levels and level spacing in nuclear physics [11], and calculation of the multiple- 
input multiple-output (MIMO) channel capacity in wireless communications [17]. The 
singular value distribution of a single Gaussian random matrix is given in [15]. How- 
ever, the joint singular value distribution of correlated Gaussian random matrices 
have received less attention so far, although it has important applications in wireless 
MIMO communications, say, the second-order statistics of the ei^era-channels [22] and 
instantaneous mutual information [20,21,23]. 

To the best of our knowledge, correlated random matrices have been studied to 
some extent [4, 11, 12], where only Hermitian matrices were considered. Different 
from [4, 11, 12], we consider the situation where the elements, with the same indices, 
of the two rectangular complex Gaussian random matrices are correlated by a complex 
number, and derive exact analytical closed-form expressions for the joint PDF of their 
singular values. 

This paper is organized as follows. Section 2 introduces the two rectangular 
complex Gaussian random matrices. The joint PDF of singular values are studied in 
section 3 using an Itzykson-Zuber-type integral. The joint marginal PDF of singular 
values is derived in section 4 and its application to wireless MIMO communications 
is presented in section 5. Finally, concluding remarks are summarized in section 6. 

Notation: is reserved for matrix Hermitian, for matrix transpose, •* for 
complex conjugate, tr[-] for the trace of a matrix, j for ^/—l, E[-] for mathematical 
expectation, 1^ for the m x m identity matrix, (E) for the Kronecker product, and 
5R[-] and 5[-] for the real and imaginary parts of a complex number, respectively. In 
addition, diag(s) denotes a diagonal matrix with s on the main diagonal, t€[m,n] 
implies that t, to, and n are all integers such that m < t < n with m < n, and 
det \xki\ is the determinant of the matrix, where Xki resides on the k^^ row and l^^ 
column. Moreover, lower-case bold letters represent row vectors, whereas upper-case 
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bold letters are used for matrices. Finally CM means complex normal, and vec(-) 
stacks all the columns of its matrix argument into one tall column vector. 

2. Problem Description. There are two m x n random matrices H = (/ly) 
and G = (Sy), i G j S [Ij?^]! each with i.i.d complex zero-mean unit-variance 



Gaussian entries, i.e., E[/iij] = IE[(7y] 



^[gtjgL] = 5ip5jq, where 



the Kronecker symbol 5ij is 1 or when i = j or i ^ j. Therefore H, G ~ CAf{0, I„i„). 
Moreover, the correlation among the two random matrices is given by 

Hhijg*g]::^ p6ip5jq, \/i,j,p,q, (2.1) 

where p = \p\e^^ is a complex number with \p\ < 1. 

Without loss of generality, we assume m < n and set v = n — m. Based on 
the singular value decomposition (SVD), H and G can be, respectively, diagonalizcd 
as [7] 



H = USVt, 
G = URVt, 



(2.2) 
(2.3) 

, s„i] and r = 



where S = [diag(s) O] and R = [diag(r) O] with s ~ [si,S2, 
[fi, f2, ■ ■ ■ respectively. 

We assume that the singular values of G, ri,r2, ■ ■ ■ ,rjn, are unordered and the 
singular values of H, si, S2, ■ ■ ■ , Sm, are also unordered. Now we would like to know 
the joint PDF of {ri}"^-^ and {si}]^^. Moreover, with r randomly selected from 
ri,r2, - ■ ■ ,Tm, and s randomly selected from si, S2, Sm, it is of interest to derive 
the joint PDF of r and s as well. These two PDFs are derived in Section 3 and 4, 
respectively. 

3. Joint PDF of {s/j^^i and {r/}™^. Lemma 3.1 (Joint PDF of H and 
G). For two correlated rectangular complex Gaussian random matrices, H, G ~ 
CA/'(0,Im„), with the correlation between H and G given by (2.1), the joint PDF of 
H and G is given by 

tr(HHt + GGt - p*HGt - pGH^) 



P(H,G) = 



1 

7r2™" (1 - |p|2)' 



■ exp 



(3.1) 



Proof. We set h = vec(H), g = vec(G), and x = [h-^ g"'"]"'"- Based on H, G ~ 
CA/'(0,I„i„) and (2.1), we have the mean and covariance matrix of x as E[x] = and 



with 



by [10] 



1 p 
p* 1 



respectively. Therefore the PDF of x is given 



p(x) 



■ exp (— x^E^ "'^x) 



where dot iSxl (det \T.r\y 



With E: 



1 -P 
-p* 1 



-™"dct I Ex, 

{i-\p\T\ 

we obtain = Sr-"^®!,- 



(3.2) 



Therefore x^E^^^ (3-2) can be rewritten as 

1 



x^E^^'^x = tr (E^^'^xx 



tr 



1-H 



hht hgt 
ght ggt 



tr (hht + ggt - p*hgt - pght) tr(HHt + GGt _ p*HGt - pGRt 



l-\p\' 



l-\p\' 



(3.3) 
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where tr (AB'^) = vec(B)'l' vec(A) = tr [vec(A) vec(B)'l'] [6] is used in the last "=" of 
(3.3). Substitution of (3.3) into (3.2) leads to (3.1). □ 

Prom (2.2), we know that the unitary matrix pair (U, V) parameterizes the coset 
space U{m) x U{n)/ [^^(1)]™, where U{p) is the unitary group of order p, and the 
integration measure, d[H] = Hi^li 11^=1 ^ [^^y ] [^^y ]' can be represented by [8] 



d[H] = r2J(s)rf[s]d^(U,V), 



(3.4) 



where J(s) ~ A (s ) J^^j^ with the m-dimensional Vandcrmonde determinant 



A(s2) = det 



2(1-1) 



I\u>i{^l~^l) and A2(.) = [A(.)]^ d[s] = YWl.dsu d/i(U, V) 



is the Haar measure oiU{m) xU{n)/ [Z-/(l)]'" [8], and the constant il is given by [8,14] 



SI 



2™7r'' 



2"7r" 



nr=i + - 1)! m! UTJo + ^) 



(3.5) 



Similarly, wc have 



d[G] = nJ{r)d[r]d^l{XJ,V), 



(3.6) 



where J(r) ~ A (r ) nfc=i ^fc"^ with the m-dimcnsional Vandcrmonde determinant 

A(r2) = det |rf | = Ukyiirl - rf) and d[r] = nl^i ^n. 

In order to obtain the joint PDF of {n}|lLi and {s;}[^j^, we need the following 
proposition. 

Proposition 3.2 (An Itzykson-Zuber-type integral [8, (31)]). 

f , , i trf(H-G)(H-G)t] 1 

J d^l{v, V) cxp I — ^ ^ ^ \ 

CP (-^) 



(3.7) 



where ft is given by (3.5) and Ik {z) = ^J^e^'^°^^cos{k6)d9 is the k*'^ order modified 
Bessel Junction of the first kind. 

Theorem 3.3. The joint PDF of the singular values ofH and G is given by 



cxp 



p(s,r) 



^\=\i^"'A A(s2)A(r2 



T I 2|p|sfcri 



2-2'»m!m! UT^o Mi + i^)!|p|""-™(l - \p\^y 



(3.8) 



Proof. By combining (3.1) with (3.4) and (3.6), we obtain 

172j(s)J(r) 



p(s,r) 



$(s,r). 



(3.9) 
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where 

*(s,r)= /d^(U,V) /d/i(U,V)cxp 



tr(HHt + GGt-p*HGt-pGHt) 



, ^ . tr [(H-pG)(H-pG)tl , ,1 
dA^(U, V) / rfM(U, V) cxp <( ^ ^ ^^ -tr(GGT)l , 

/ tr[(H-pG)(H-pG)t]l 



d/.(U,V)- 



'Er=l'~'(l - |p|2)m"-m 



2|p|sfcri 



2-™m!7r-"™f7A(s2)A(|p|2r2)nr=i(lpkfcffe)'' 



exp 



det 



r / 2|p|sfcrj \ 



2-™m!7r-"™17|p|""'-™A(s2)A(r2)[]"^^(sfcrfe)'' 



(3.10) 



Derivation of the second and third hnes of (3.10) arc straightforward. The fourth hnc 
comes from 



pG = URVt 



(3.11) 



with R = |p|R, and Proposition 3.2 with the replacements t ^ 1 — jpp and G pG. 
The last line is based on the convention that Jdp{XJ ,Y) ^ 1 [8]. Plugging (3.5) and 
the last line of (3.10) into (3.9), we obtain (3.8). □ 

By relating the eigenvalues of GG^ to the singular values of G through ai = rf, 
I ^ [1, "i] , and the eigenvalues of HHt to the singular values of H through /3; = sf, I G 
[1, to], we can derive the joint PDF of a = [ai,a2, - ■ ■ , a„i] and /3 = /32, • • • , Z?™], 
presented in the following corollary. 

Corollary 3.4. The joint PDF of the unordered eigenvalues o/HH'^ and GG^ 

is 



cxp 



A{f3)Aia)lYL,{VP^r det 



2\p\^Pkai 



"(1 - |p|2)™ 

(_3.12) 

where m- dimensional Vandermonde determinants are defined by A(/3) = det |/?^ "'^ | = 

Ilk>iiPk - fii) and A{cx) = det \a[7^\ = nfc>;("fc - «;)• 

Proof. It is straightforward to obtain (3.12) from (3.8) by 2to one-to-one nonlinear 
mappings. □ 

4. Joint Marginal PDF. In this section, with (3 = s'^ and a = 7-2, we calculate 
the joint marginal PDF of /3 and a, p(/?, a), using the techniques and results presented 
in [4, 12]. Then the joint PDF of s and r, p{s,r), is easily derived. 

If the polynomials Pfc(/3) and Qi{a), satisfy / w{(3, a)Pk{(3)Qi{a)d(3da ~ 5ki, then 
we call Pk{(3) and Qi{a) as bi-orthogonal polynomials, associated with the weight 
function w{(3,a) [11]. With this definition, we have the following Lemma. 
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Lemma 4.1. There exist bi-polynomials, Pk{P) and Qi{a), and a weight Junction, 
w(/3, a), which reduce (3.12) to the following form 

pi(3,a)^Ci dct\Pk-iif3i)\dct\w{(3k,ai)\dct\Qk-iiai)\, (4.1) 

where Ci is a normalization constant. 

Proof. In this paper, is a non-negative integer. Using the Hille-Hardy formula [2, 
pp. 185, (46)] 

with L''j.{x) = jfe^'x~^jg;{e^^x^^'') as the associated Laguerre polynomial, we can 
rewrite (3.12) as 

A(/3)A(«)det /?-e-^^are-"'E;:o ^"''"'f^l'^^^"'^ 



We set the weight function, w(/3, a), as 

j\\p\^=mm{a) 



w(/?, a) = /3''a''e-(^+"' ^ 



(/3«)^e-T^/.(^) 



(4.4) 



(i-IpP)IpI- 

It is easy to check that the corresponding bi-orthogonal polynomials are given by 



= J(^f^|pr'i^(/3), (4.5) 



QK«) = ^(7^ipr'ir(«), (4.6) 

using the following integral equality [2, pp. 267, 7.414.3] 

e--x^Ll{x)L'({x) = (4.7) 

Moreover, by the addition of multiples of rows of lower order which do not change 
the determinant of the Vandcrmondc matrix, then each of the rows can be expressed in 
terms of orthogonal polynomials with respect to the weight function u'(/3, a). There- 
fore two TO-dimensional Vandermonde determinants, A(/3) and A (a), can be repre- 
sented as 

A(/3) =dct|/3[-i| = Cadet |Pfe_i(/30l, (4.8) 
A(a) =det|4-i| =C3det|Qfe_i(az)|, (4.9) 

where wc use the fact that the matrix transpose does not change the determinant, 
i.e., det \Pi-i{Pk)\ - det |Pfe-i(/30l and det \Qi-i{(ik)\ = dot |Ofe-i(A)|. 
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The coefficient of x'^ in L'^{x) is ^ ^} , then the coefficient of in Pk{x) is 
('^^'I^I' V^kU)! ' therefore wc have C2 = nr=o'(-lP |PPV7!(7+^ = (-1)^^ 
X y^|p|m(™-i)J]J^-ij!(j + i/)!, obtained by plugging (4.5) into (4.8). Similarly, substi- 
tution of (4.6) into (4.9) gives C3 = C2. Now the product of (4.8) and (4.9) results in 



rn — l 

A(/3)A(a) = |pr("-i) J] j!(j- + z.)!det|Pfc_i(A)|det|Q,.„i(aOI- (4.10) 

j=o 

Based on (4.4) and (4.10), one can sec that (4.3) is equal to (4.1) with Ci = } , . 

□ 

Theorem 4.2. The joint PDF of (3 and a is given by 
' m2(l-H2)|p|^ A. (fc + ^.)! |p|2fc 



(.. + .)■(/ + .)■ { [^^(/5)^r(ar + [^r(/3)^^(a)]^ 

[IpI^^'-^) + IpI'^'^-')] L^(/3)ir(/3)i^(«)^r(«)}|- (4.11) 



0<k<l 



Proof. Based on Lemma 4.1, and the results presented in [12, (3.7)] [4], p{(3,a) 
can be expressed as 



k=0 0<k<l 



PkiP) P_k{a) 
Piif3) Pi{a) 



det 



(4.12) 

where Pk{x) and Qk{x) are defined in (4.5) and (4.6), respectively, the weight fimction 
is presented in (4.4), and Pk{a) and Q;(/3) are similarly defined as [12] 



Pk{a) = I PkiP)wiP, a)dp = J ^^^a'-e-'^lpl'^LUa), (4.13) 



QiW = / Qiic^Mfi, a)da = ^ -JL^p'-e-^lpl'LUP). (4.14) 

Plugging (4.4), (4.5), (4.6), (4.13) and (4.14) into (4.12), we arrive at (4.11). □ 
It is straightforward to obtain the joint PDF of s and r from (4.11), according to 
these one-to-one mappings s — ^7/3 and r = ^fa.. 

The joint PDF in (4.11) includes many existing PDF's as special cases. 
• By integration over /?, (4.11) reduces to the marginal PDF 

1 '"-1 u 
fc=0 ^ '' 
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which is the same as the PDF presented in [17]. When rn — 1, (4.15) further 
reduces to 



p{a) 



1 



in -I) 



(4.16) 



which is the distribution with 2ti degrees of freedom [16, (2.32)]. 
• With m = 1, (4.11) reduces to [19], 



p(a,/?) = 



(a/?)^exp(-^)/„_ 



2\pU/ap 



(n-l)!(l-|p|2)|p|«-i 
Furthermore, when n = 1, (4.17) simphfies to 

1 



1-\P\'- 



■ cxp 



a + f3\ f 2\p\V^ \ 

i-\p\y °u-ipiv 



(4.17) 



(4.18) 



which is identical to (8-103) [3, pp. 163], after two one-to-one nonhncar 
transformations. 

For the apphcation discussed in section 5, we need the joint marginal PDF of (j> 
and ip, p{(j)^Lp), where tj) ^'Hd ^-re randomly selected from {afcj^j^, m > 2. Using 
the technique in [4, 12], we have the following theorem. 

Theorem 4.3. If (j) md ip are randomly selected from {a/c}fcLi; their joint PDF 
is given by 



{(j)LpY e-'^'I'+'P^ kW. 
m{m - 1) ^ (fc + i^y.{l + v) 



k.l=0 
k^l 



^{[Lu^)Lr{v)f~Lu^)Lrmi{^)Lr{^)}. 

(4.19) 



Proof. According to (1.6) and (2.14) in [12] wc have 

1 



P(0, </5) 



m(m — 1) 



det 



if (0,0) K(0,(^) 



(4.20) 



where K{xi,X2) = TJl'J Pk{xi)Qk{x2). With Pk{xi) in (4.5) and QJxa) in (4.14), 
we obtain (4.19) after some simple algebraic manipulations. □ 

5. Application to Wireless MIMO Communication Systems. ForanA'ff X 
Nt MIMO time-varying Rayleigh flat fading channel [18] with Nt transmitters and 
Nn receivers, the channel impulse response at time instant t is given by 



Hit) 



' hi. lit) 
hNR,iit) 



hl^Nrit) 
hNR.Nrit), 



(5.1) 



We assume all the NuNt sub-channels in the MIMO system, {^ij"(0}(i^i j'Li) ^'^^ 
i.i.d., with the same temporal correlation coefficient, i.e.. 



^h,,{t)h;jt - t)] = s^pSjgPhiT), 



(5.2) 
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where /0/i(t) = Jo(27r/£ir) [9] in isotropic scattering environments^, with Jo{x) = 
Iq{~jx) [5, pp. 961, 8.406.3] and f]j is the maximum Doppler frequency shift. 

We set n = max(A'R, Nt) and m = min(iVR, Nt). According to (2.2), H(t) can be 
diagonahzed as 

H(t) = U(t)S(t)V^(t), (5.3) 

where S{t) = [diag(s(<)) O] with s{t) = [si{t), 32(1), ■ ■ ■ ,Sm(i)] for Nr < Nr, and 
diag(s(t))" 







for Nr > Nt- Therefore the MIMO channel, H(i), is decomposed 



to m idcnticaUy distributed eigen- channels Afc(t) = s|(i), k € [l,m], by SVD. 

In wireless MIMO communication systems, we are interested in the correlation 
coefficient between any two ez(7en-channels, which is defined by 

.^ E[Afc(t)Az(t-r)]-E[Afc(t)]E[A;(t)] 
Pk,i[T) = , , - ■ (5.4) 



y^E [Xlit)] {E [Afc(t)]}yE [Xf{t)] - {E [Mt)]}' 



For simplicity, in this paper we only consider a 2 x 2 MIMO system, Nr ~ Nr = 2, 
where the correlation coefficient, pk.i{T), can be shown to be 

with Jo(-) — [Jo(-)]^- To derive (5.5), we note that for r = and k = I, pk.i{0) — 1 
because of the definition of the correlation coefficient. Since to = 2, for any eigen- 
channel at the time instant t, it is easy to show that the mean value of Xk{t) is 
E[Xk{t)] = 2, Vfc, and the second moment of Afc(t) is E [Xl{t)] = 8, Vfc, using the 
PDF in (4.15). For r = and k ^ I, we obtain E[Xkit)Xi{t)] = 2 by (4.19), hence 
,(0) = -i, \/k ^l. For r 7^ and Vfc, it is not difficult to get E [Afe(t)A;(i - t)] = 
4+ |/0/i(r)p using (4.11), therefore we have the second line in (5.5). 

Monte Carlo simulations are performed to verify the result in (5.5). In all simu- 
lations^, the maximum Doppler frequency fn is set to 1 Hz, and the sampling period, 
Ts, is equal to YocSfffo • simulation results are shown in FiG. 5.1, where the upper 
figure shows the channel correlation coefficient Ph{T) ~ Jq {27r fj^r), Clarke's correla- 
tion model, whereas the lower figure presents the correlation coefficient between any 
two e«(?era-channels or for any individual eigen-channel, Eq. (5.5). Since Jq{2tt for) is 
an even function of r, the correlation coefficients are plotted for r > 0. In all figures, 
"Simu." indicates the curve is obtained by Monte Carlo simulations, whereas "Theo." 
means theoretical. From FiG. 5.1 we can conclude that the new theoretical result in 
(5.5) is confirmed by simulation very well. 

6. Conclusion. In this paper, the joint distribution of singular values of two 
correlated rectangular complex Gaussian random matrices is derived, as well as the 
joint marginal distribution. The derived distributions play an important role in the 
analysis and design of wireless MIMO communication systems. As an example, the 
correlation coefficient of any two ez^en-channels of a 2 x 2 MIMO system is obtained 
and verified by the Monte Carlo simulations in this paper. 



^In the non-isotropic scattering environment, Phij), in general, is a complex- value function [20, 
21], and \p}i{t)\ indicates its amplitude at the time delay t. 

^The spectral method [1] is used to generate the MIMO channels. 
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Fig. 5.1. The channel correlation coefficient, ph{T), o,nd correlation coefficient of any two 
eig en- channels, i{t), in a 2 x 2 MIMO system with Clarke's correlation model. Note that the 
sampling period, Ts, is ^qqqj-^ in Monte Carlo simulations, therefore the first non-zero r isTs, i.e., 
1000 /b ' '"'^^^^ corresponds to /or = j^qq in the horizontal axis. 
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